Reporting  Limit  (RL) 


Presenter 

Chung-Rei  Mao,  Ph.D. 

Chemist,  Environmental  and  Munitions 
Center  of  Expertise 

US  Army  Engineering  and  Support 
Center  Huntsville,  AL 

31  March  2011 


US  Army  Corps  of  Engineers 

BUILDING  STRONG® 


Report  Documentation  Page 


Form  Approved 
OMB  No.  0704-0188 


Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
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•  Summary 
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BUILDING  STRONG, 


Introduction 


*  Reporting  Limit  (RL)  is  widely  used  but  not  clearly 
defined.  For  example: 

>  RL  -  the  minimum  value  below  which  data  are  documented 

as  non-detects  -  EPA  OW,  Office  of  Resource  Conservation  and  Recovery 
(ORCR),  and  Office  of  Enforcement  and  Compliance  Assurance  (OECA) 

>  RL  -  the  minimum  value  of  the  calibration  range.  Analyte 
detections  between  the  detection  limit  and  the  reporting 
limit  are  reported  as  estimated  -  epa  ord  and  orcr 

>  RL  >  MDL  and  the  client  and/or  data-users  determine  RL 

-  California  Department  of  Health 


•  Many  projects  improperly  set  RL  at  contract  lab’s 
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BUILDING  STRONG, 


RL  in  DoD  QSM 


•  DoD  QSM  Version  4.2: 

>  RL  -  a  client-specified  lowest  concentration  value  that 
meets  project  requirements  for  quantitative  data  with 
known  precision  and  bias  for  a  specific  analyte  in  a 
specific  matrix 

>  RL  =  Client-specified  quantitation  limit  that  meets  project 
data  quality  needs 

>  RL  is  clearly  defined  in  the  DoD  QSM  but . 

. without  determination  procedure 
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BUILDING  STRONG, 


Project-Specific  RL 

•  Why  is  a  Project-Specific  RL  needed? 

>  To  reliably  determine  if  a  site  is  CLEAN 

S  CLEAN:  [X]  <  Regulatory  Level,  Background  Level, 
Risk-Based  Level,  etc.,  i.e.,  Action  Level  (AL) 

S  Procedure:  comparison  of  [X],  mean,  etc.  with  AL 

s  Need  to  determine  or  estimate  true  analyte 

concentration  with  uncertainty  at  Project-Specific  RL 
(i.e.,  Decision  Level) 


>  To  select  analytical  methods  and  labs 
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BUILDING  STRONG, 


May  RL  =  AL? 


•  To  reliably  determine  if  a  site  is  clean,  one 
needs  to  determine  if  [X]  <  AL 

•  Problems  with  RL  =  AL 


X  AL 

True  [X]  <  AL 
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BUILDING  STRONG, 


Is  [X]  <  AL? 

•  Is  [X]  <  AL?  [X]  =  single/multi-measurements 
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BUILDING  STRONG, 


Need  Quantitation  at  RL  <  AL 


•  To  determine  if  [X]  <  AL,  one  needs  to 
quantify  [X]  at  Project-Specific  RL 

•  Project-Specific  RL  depends  on: 

>  AL  (regulatory  level,  background,  risk-based, 
etc.) 

>  Data  Quality  (precision  &  bias) 

>  Tolerable  Decision  Errors  (FP/FN,  Type  I/ll) 

•  RL  <  AL  but  how  much  lower  depends  on 
Data  Quality  and  Tolerable  Decision  Errors 

ira 
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BUILDING  STRONG, 


Data  Quality  -  Precision 


RSD  =  5% 


/ 


FP  =  5% 


RL  AL 


RSD  =  10% 


FP  =  5% 


RL 


AL 


RSD  =  15% 


FP  =  5% 


BUILDING  STRONG, 


Tolerable  Decision  Error  -  FP 


RSD  =  10% 


RSD  =  10% 


FP  =  5% 


RL 


AL 


RSD  =  10% 


FP  =  1% 


RL 


AL 


rH 


BUILDING  STRONG, 


RL  vs.  AL,  DQ,  &  TDE 


•  Project-Specific  RL  depends  on: 

>  RL  <  AL 

>  RL  l  if  Data  Quality  (DQ)  i 

>  RL  4-  if  Tolerable  Decision  Errors  (TDE)  i 

•  How  to  establish  a  Project-Specific  RL? 
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BUILDING  STRONG, 


How’s  RL  Commonly  Established? 

•  RL  =  Lab’s  LOQ  (~  80%  projects)  ~'J 

•  RL  =  Lab’s  MDL  ~ 

•  RL  =  Regulatory  Limit  j 

•  RL  =  AL  ^ 

•  RL  =  Vz  AL  ~y 

•  RL  =  3  -  5  times  less  than  AL 
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BUILDING  STRONG, 


Common  Reasons  for 
Lack  of  Project-Specific  RL 


•  Don’t  know  how 

•  Unknown  data  quality  before  analysis 

•  Huge  field  sampling  errors 

•  Risk  assessor  establishes 

>  PMs  believe  RL  in  number  is  adequate 


Limited  resources 
Pandora’s  box 
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BUILDING  STRONG, 


Inputs  for  Establishing 
Project-Specific  RL 


•  Action  Level  (AL);  Regulatory  level, 
background  level,  risk-based  level,  etc. 

•  Anticipated  Data  Quality:  Based  on  DQOs, 
historical  data,  method,  publication,  etc. 

•  Tolerable  Decision  Errors:  Type  I/ll  (a/p)  or 
FP/FN  (Default  a  =  p  =  0.05  or  FP  =  FN  =  5%) 


BUILDING  STRONG® 


Procedure  for  Establishing  RL 


H0:  X  >  AL,  Ha:  X  <  AL;  decision  errors  a  =  p  =  0.05 


Gray  Region  A  A  =  kx  RSD  x  AL 


RL  <  (AL  -  A)  x  %R  =  (AL  -  k  x  RSD  x  AL)  x  %R,  where 
k  =  Error  Factor,  RSD  =  Rel  Std  Dev,  %R  =  Recovery 


l  I  I 
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BUILDING  STRONG, 


Determine  n,  RSD,  &  %R 

•  RL  <  (AL  -  k  x  RSD  x  AL)  x  %R 

>  k  =  4  if  FP  =  FN  =  5%  (2  RSD  +  2  RSD) 

>  k  =  5  if  FP  =  1%  (3  RSD)  &  FN  =  5%  (2  RSD) 

>  k  =  6  if  FP  =  FN  =  1%  (3  RSD  +  3  RSD) 

•  RSD  <  [1  -  RL  /  (AL  x  %r)]  /  k 

>  If  k  =  4,  RSD  must  be  <  25% 

>  If  k  =  5,  RSD  must  be  <  20% 

>  If  k  =  6,  RSD  must  be  <  17% 


k  is  based  on  tolerable  decision  errors 
RSD  &  %R  are  data  quality  indicators  at  RL 
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BUILDING  STRONG, 


Determine  AL,  DQ,  &  TDEs 


•  Action  Level  (AL):  Regulatory  level, 
background,  risk-based  level,  etc. 


•  Anticipated  Data  Quality:  Based  on  DQOs, 

historical  data,  method,  publication,  etc. 

>  Historical  data 

>  DoD  QSM  LCS  Control  Limits 

>  Technology  capabilities 


•  Tolerable  Decision  Errors:  Type  I/ll  (a/p) 

>  Regulations 

>  Practicality 

>  Resources 
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BUILDING  STRONG, 


Applications  of  RL 


•  Select  analytical  methods 

>  RL  vs.  method  performance 


•  Select  analytical  labs 

>  RL  vs.  lab  performance 

•  Assess  data  quality 

>  Lab  LOQ  vs.  project  RL  (LOQ  <  RL  if  compatible 
precision  and  bias) 


Assess  data  usability 

>  Lab  LOQ  vs.  project  RL  and  AL  (LOQ  <  RL  <  Aj 
if  compatible  precision  and  bias) 


l  I  I 
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BUILDING  STRONG, 


Case  Study  of  Project-Specific  RL 

•  Investigate  ground  water  contamination  by 
benzo(a)pyrene 

>  Establish  RL  and  associated  precision  &  bias 

>  Select  analytical  method  &  contract  lab 

•  Inputs: 

>  AL:  0.2  ppb  (MCL) 

>  Anticipated  Data  Quality:  RSD  =  9.5%  &  %R  =  81% 
(DoD  QSM  LCS) 

>  Tolerable  Decision  Errors:  FP  =  FN  =  5% 


RL  <  (AL  -  4  x  RSD  x  AL)  x  %R  =  0.10  ppb 
>  if  RSD  <  9.5%  &  %R  >  81% 


n  H 
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BUILDING  STRONG, 


Case  Study  of 
Method  &  Lab  Selections 

•  LOQ  <  RL  <  (AL  -  4  x  RSD  x  AL)  x  %R  =  0.10  ppb 
if  AL  =  0.2  ppb,  RSD  <  9.5%  &  %R  >  81% 


•  DoD  ELAP  accredited  Lab  X: 

77  >  SW  8270:  LOQ  =  0.2  ppb,  RSD  =  16.2%  &  %R  =  82.5% 
(Ideally,  LOQ  <  (0.2  -  4  x  16.2%  x  0.2)  x  82.5%  =  0.058  ppb) 


•  DoD  ELAP  accredited  Lab  Y: 


77  >  SW  8270:  LOQ  =  0.2  ppb,  RSD  =  9.8%  &  %R  =  84.5% 

•  >  SW  8310:  LOQ  =  0.1  ppb,  RSD  =  9.5%  &  %R  =  92.5% 


■  '■in 
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BUILDING  STRONG, 


Response 


Relationships  among  Various  Limits 


AL  >  RL  >  LOQ  >  LOD  «  2  x  DL 


99%  UCL 
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BUILDING  STRONG, 


Major  Issues 


1.  Old  Rule  of  Thumb,  RL  =  1/2  -  1/5  AL,  may  not 
be  adequate 


2.  LOQ  <  RL  is  neither  necessary  nor  sufficient; 
lower  LOQ  is  not  necessary  better  -  must 
consider  precision  &  bias  at  LOQ  and  RL 

3.  RL  based  on  precision  &  bias  of  clean  matrix 
spikes  is  a  minimum  RL 


4.  Safety  factors  built  in  AL  or  risk  assessment  do 
not  take  care  of  decision  errors 


Huge  field  sampling  errors  trump  lab  analysi 
errors 
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BUILDING  STRONG, 


Major  Issue  #  1 

Old  Rule  of  Thumb,  RL  =  1/2  -  1/5  AL,  may  not 
be  adequate 

If  AL  =  100,  is  RL  =  50  ~  20  adequate? 


>  Ideal  SW-846  default,  LCS  CL  =  70  -  130% 

(RSD  =  10%  &  %R  =  100%)  and  a  =  p  =  0.05  (k  =  4) 

RL  <  (AL  -  k  x  RSD  x  AL)  x  %R 

<  (100  -  4  x  10%  x  100)  x  100%  =  60 

1/2  ~  1/5  AL  =  50  ~  20  <  60 


>  If  LCS  CL  =  20  -  80%  (RSD  =  10%  &  %R  =  50%) 
RL  <  (100  -  4  x  10%  x  100)  x  50%  =  30 
1/2  AL  =  50  >  30  52  1/5  AL  =  20  <  30  ^ 
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BUILDING  STRONG, 


Major  Issue  #  2 

LOQ  <  RL  is  neither  necessary  nor  sufficient;  Lower 
LOQ  is  not  necessary  better  -  must  consider  P&B 


Major  Issue  #  3 

RL  based  on  precision  &  bias  of  clean  matrix 
spikes  is  a  minimum  RL 


>  Precision  &  bias  based  on  clean  matrix  spikes 
such  as  method  performance  data,  DoD  QSM,  or 
lab’s  LCS  do  not  include  matrix  interferences 

>  A  common  denominator  approach  similar  to  DL, 
QL,  and  LCS  studies  for  data  comparability 

>  Because  individual  matrices  are  different,  matrix- 
specific  precision  &  bias  cannot  be  reliably  and 
cost-effectively  estimated  prior  to  sample  analysis 


>  Matrix  interferences  may  be  assessed  upon 
sample  receipt  or  based  on  MS/MSD 
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BUILDING  STRONG, 


Major  Issue  #  4 

Safety  factors  built  in  AL  or  risk  assessment 
do  not  take  care  of  decision  errors 

>  To  have  or  not  to  have  corrective  action  generally 
depends  on  the  data  quality  and  tolerable  decision 
errors  at  the  AL,  not  the  accuracy  of  the  AL 

>  Safety  factors  may  not  affect  the  decision  rule, 
e.g.,  if  [X]  >  AL,  clean  site;  if  [X]  <  AL,  dirty  site 

>  To  reliably  determine  if  [X]  >  AL,  one  needs  to 
quantify  and  make  the  decision  at  RL 
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BUILDING  STRONG, 


Major  Issue  #  5 

Huge  field  sampling  errors  trump  lab  analysis 
errors 

>  Lab  shall  meet  project  MQOs,  not  DQOs.  Lab  is  not 
liable  for  sampling  errors  and  can't  compensate  large 
sampling  uncertainty  (Typical  lab  RSD  must  be  <  25%) 

>  Field  sampling  uncertainty  cannot  be  reliably  estimated 
without  site  investigation  and  is  typically  >  4x  lab 
uncertainty 

>  Lab  performance  yardsticks,  method  performance  data, 
do  not  include  field  sampling  uncertainty 

>  Need  better  sampling  techniques  (e.g.,  MIS)  to  reduce 

and  control  field  sampling  errors  prior  to  evaluating  pi 
field  sampling  uncertainty  |{ili 
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BUILDING  STRONG, 


Summary 


•  A  simple,  reliable,  and  practical  procedure  for 
establishing  RL  based  on  project-specific  AL, 
anticipated  data  quality,  and  tolerable  decision 
errors 


*  RL  established  based  on  precision  and  bias  of 
clean  matrix  spikes  is  a  minimum  RL.  More 
stringent  RL  is  needed  to  cover  sample  matrix 
interferences  and  field  sampling  errors 

•  A  useful  tool  for  project  planning,  selecting 
analytical  methods  and  contract  labs  prior  to 
contract  award 


•  LOQ  <  RL  <  AL  may  not  meet  project  DQOs 
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BUILDING  STRONG, 


For  more  information,  please  contact: 

Chung-Rei  Mao 

Phone:  402-697-2570 
e-mail:  chung-rei.mao(a)usace. armv.mil 
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BUILDING  STRONG, 


Questions? 
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BUILDING  STRONG, 


